


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1976-03 


Application of model output statistics to 
tropical cyclone forecasting in the western Pacific. 


Little, Robert Ernest 


Monterey, California. Naval Postgraduate School 
http://ndl.handle.net/10945/17681 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 
| (8 D U DLEY research materials and institutional publications created by the NPS community. 
«ist sia Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


NY KNOX appointed — and published -- scholarly author. 

ia) LIBRARY Dudley Knox Library / Naval Postgraduate School 

411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 












NAVAL POSTGRADUATE SCHOOL 


Monterey, California 





TRESIS 


Application of Model Output Statistics 
to Tropical Cyclone Forecasting 
in the Western Pacific 


by 


Robert Ernest Little 


March 1976 


Co-Advisor: jen. Os Jarre LE 
Co-Advisor: W. Van Der Bijl 





Approved for public release; distribution unlimited. 


1173227 








SECURITY CLASSIFICATION OF THIS PAGE (When Date Entered) 


REPORT DOCUMENTATION PAGE 


» REPORT NUMBER 2. GOVT ACCESSION NOJ 3. RECIPIENT'S CATALOG NUMBER 


4. TITLE (and Subtitie) S. TYPE OF REPORT & PERIOO COVERED 
Master's Thesis 
March 1976 


6. PERFORMING ORG. REPORT NUMBER 


8. CONTRACT OR GRANT NUMBER(Q) 

















Application of Model Output Statistics 
to Tropical Cyclone Forecasting in the 





7. AUTHOR(e) 


Robert Ernest Little 







10. PROGRAM ELEMENT, PROJECT, TASK 
AREA & WORK UNIT NUMBERS 


12. REPORT DATE 
March 1976 
13. NUMMER OF PAGES 
34 


| 18. SECURITY CLASS. (of thie raport) > 





9. PERFORMING ORGANIZATION NAME ANDO ADODAESS 









Naval Postgraduate School 
Monterey, California 93940 


CONTROLLING OF FICE NAME ANO ADORESS 
















Naval Postgraduate School 
Monterey, California 93940 


. MONITORING AGENCY NAME & ADDRESS! difierent (rom Controlling Oltice) 








Unclassified 
Naval Postgraduate School 
Monterey, California 93940 . [15a DECLASSIFICATION/ DOWNGRADING 


- OISTRIBUTION STATEMENT (of thle Report) 


Apvroved for public release; distribution unlimited 


. DISTRIBUTION STATEMENT (of the abstract entered in Block 20, if different tram Report) 


- SUPPLEMENTARY NOTES 


- KEY WORDS (Continue on reveree cide if neceseary and identify by biock number) 
Tropical cyclones Forecast 
Ridge regression Analog 
meget Output Statistics Track 


- ABSTRACT (Continue on reveree side if neceesary and identity by block mamber) 


Analog tropical cyclone forecasting techniques inherently 
include some mean interaction.of the cyclone with its synovotic 
environment. This investigation seeks to relate current syno- 
tic features to storm displacement. The objective forecasting 
technique, Model Outvout Statistics (MOS), along with the so 
called "ridge regression" biased estimator are used to vredict 
recurvature or non-recurvature of tropical cyclones. Correc- 





DD i en 73 1473 EDITION OF 1 Nov 68 1s OBSOLETE 


(Page 1) S/N 0102°-014- 6601 | imine RESIN GTI AGER ET TST AGE (BERED GLUE 
| Teen <EASSIEIC ATION OF Mis EAOe (Piero seta 





a a a 
Sc cusiTyY CLASSIFICATION OF THIS PAGE(When Deta Entered 





tions to an analog forecast position are also predicted. It 

4s shown that a larger data set is required before any conclu- 
sive results in predicting recurvature or non-recurvature can 
be made. However, the most fruitful area for application of 
MOS does appear to be in the recurvature / non-recurvature 
problem and not in the area of corrections to an analog fore- 
cast. The ridge regression estimator generally proves superior 
to the ordinary least squares estimator as a method of deter- 
mining predictive equations. 


DD. Form. 1478 
1 Jan 73 = 
S/N 0102-014-6601 2 SECURITY CLASSIFICATION OF THIS PAGE(WhHen Data Entered) 





Avo scALLON OF NODE OURCOT STATISTICS TO TROPICAL CYCLONE 
FORECASTING IN THE WESTERN PACIFIC 


by 


; Robert Ernest et 
Lieutenant-United States Ney 
B. S., University of Nebraska, 1970 


Submitted in partial fulfillment of the 
requirements for the degree of 


MASTER OF SCIENCE IN METEOROLOGY 


from the 





V IAIAY PImemaryu 
é i. | , 


iL POSTGRADUATE SCHOOL 
EREY, CALIFORNIA 93949 


ABSTRACT 


Analog tropical cyclone forecasting techniques 
inherently include some mean interaction of the 
cyclone with its synoptic environment. This 
investigation seeks to relate CULE eat synoptic 
features to storm displacement. The objective 
forecasting technique, Model Output Statistics (MOS), 
along with the so called "ridge regression" biased 
estimator are used £O predict recuLrvature or 
non—-recurvature of tropical cyclones. Corrections to 
an analog forecast position are also predicted. It is 
Shown that a larger data set is required before any 
conclusive results in predicting recurvature Or 
non-recurvature can ‘be made. However, the most 
fruitful area for application of MOS does appear to be 
in the frecurvature / non-recurvature problem and not 
in the area of corrections to an analog forecast. The 
ridge regression estimator generally proves superior 
to the ordinary least squares estimator as a method of 


determining predictive equations. 
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I. INTRODUCTION 


The development of analog techniques in forecasting is a 
logical extension to the experienced forecaster's recalling 
of past storms or synoptic situations. The latter should of 
course resemble the current situation in its essential 
Characteristics. After some mental averaging the analog 
forecaster assumes that Similar patterns will retain a 
certain degree of Similarity through some period of further 
development, Generally, analog techniques select from 
climatological history a sample of analog storms which neet 
specific criteria with respect to the current storn, 
regarding date, geographical location, heading, and _ speed. 
Each analog storm is translated to the current position and 
Started at the current storm's speed and heading. An average 
of the tracks which the analog storms subsequently followed 
1s computed and used as guidance in forecasting the current 


storn's future track. 


Analog forecasting techniques have been developed to 
forecast objectively the position of tropical cyclones in 
the Pacific by Jarrell and Somervell (1970) and in the 
Atlantic by Neumann and Hope (1970). The analog techniques 
have shown skill in forecasting tropical cyclones, and 
reflect to some degree most of the tracks future cyclones 
Will take. The large climatological data base lends itself 
to statistically determined limits on the most likely 


tracks. 


There are several areas of limitation in the analog 
technigues. First, they cannot forecast for storms which are 


far removed from the climatological mean for which there are 





few if any analog storms. Second, they tend to forecast the 
least likely middle ground between the highly traveled 
westward track and the similarly frequented north or north- 
eastward recurvature path. Third, when separate means are 
used that include only recurving or straight analogs, such 
as is used in the analog program (TYFOON 73) at the Fleet 
Weather Central / Joint Typhoon Warning Center, Guan 
(FLEWEACEN / JTWC), the major problem of deciding between 
the two remains. Neumann and Hope (1972) found that tke 
analog technique when applied to recurving storms had mean 
displacement errors approximately twice those of westward 


tracking storms. The analog technique inherently includes 


the interaction of the . cyclone with its synoptic 
environment, which becomes more variable at the 
mid-latitudes of the recurving cyclone. However, the 


computed mean analog track only represents some average 
synoptic situation, and therefore the use of some current 
synoptic features, which can be related to storn 
displacement by statistically determined coefficients, 


should improve the accuracy. 


The objective of this thesis was to investigate the 
relationships between current synoptic features and their 
influence on storm displacement. The technique of Model 
Output Statistics (MOS) given by the so called "ridge 
Cegression" type of biased eStimator, vice the least Squares 
estimator, were used to predict recurvature or 


non-recurvature of tropical cyclones in the Western Pacific. 


Corrections to an analog forecast position, given a 
recurvature Or non-recurvature £LOEeCasSt, were also 
predicted. 
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II. DATA AND PREDICTORS 


== = eS 7 SS ee ee ee 


A. DATA 


Historical data were obtained from the Fleet Weather 
Central ys Joint Typhoon Warning Center, Guam, and the Fleet 
Numerical Weather Central (FNWC), monterey. The FLEWEACEN / 
JTWC data were for the tropical cyclones of 1974 and 1975 in 
the Western Pacific. The data were supplied at synoptic 
times 0000, 0600, 1200, and 1800 GMT, which represent 
effective times for FPLEWEACEN / JTWC tropical cyclone 
warnings. At each of these warning times the JTWC initial 
position with the 24, 48, and 72 hour forecast positions” 
from each of two versions of the TYFOON analog program were 
given. One technigue was based on a history of "straight 
running" storms while the other was based on a history of 
“"recurving"™ storms. The FNWC data were Northern Hemisphere 
63 by 63 grid 500-mb height fields and surface pressure 
fields. Analysis fields as well as 24, 48, and 72-hour 
primitive equation prognostic fields were provided for the 
initial times 0000 and 1200 GMT. 


The date time group of each JTWC storm warning was 
linked with the FNWC field times either 12 or 18 hours 
earlier since these were the latest field data operationally 
available at warning time. At each matching of data a 
forecast case was identified. For the years 1974 and 1975 
data were available for a total of 564 24-hour forecast 
cases of which 356 persisted to 48 hours and 208 to 72 


hours. These cases represented some portion of 44 tropical 
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cyclones. 


Gross error checks were performed on the data, and 
errors recognized as clerical in nature were corrected where 
possible. Four cases with unreconcilable errors were 
eliminated. Approximately 80 percent of the cases (457) were 
used in the development of the forecasting technique, and 20 
percent (125) were reserved as independent test cases. The 
independent sample was selected uniformly by using all the 


forecast cases from every sixth tropical cyclone. 


Bee PREDICTORS 


For each forecast case (recall the matching of data) 234 
possible predictors were calculated. (see Figure 1.) At 
each of the 14 points noted in figure 1., which were 
derived from the two proposed analog tracks, two gradients 
were measured on each of the eight different fields. When 
predicting recurvature or non-recurvature, the gradients 
parallel and normal to the proposed track were measured. 
This orientation was thought to be most sensitive to 
pressure gradients parallel to the track which would 
correspond to steering flow ‘normal to the track. When 
predicting corrections to the analog forecast positions, the 
gradients were measured North/South and East/West about the 
point. The distance over which the gradients were measured 
was six degrees of latitude or three degrees on either side 
of the respective point. Each gradient measured was a 


potential predictor. 
In the recurvature / non-recurvature problen, the 


predictand was the sguare of the distance from the verifying 


position to the (TYFOON) straight forecast, minus the square 
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Of the distance from the verifying position to the (TYFOON) 
recurve forecast. In the correction problem, predictands 
were North/South and East/West distances from the (TYFOON) 


straight and recurve forecasts to the verifying positions. 


The 234 predictors were screened in two steps. The first 
step ranked the top 50 predictors by size of their 
coefficient's of correlation with the predictand. The second 
step selected 12 predictors from this group by the "ridge 
trace" technigue which will be discussed in a later section. 


The choice of 12 predictors was purely arbitrary. 
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III. DISCUSSION OF FORECAST TOOLS 





A. MODEL OUTPUT STATISTICS 


Model Output Statistics is an objective technique which 
determines the statistical relationship between a predictand 
and variables forecast by a numerical model. In general 
application, this statistical relationship is applied to the 
output of a numerical model, for some model forecast time, 


to get an estimate of the predictand at that same time. 


In this investigation the FNWC primitive equation nodel 
supplied the numerical output as was described in the data 
section. The statistical relationships were determined by a 
"ridge regression" technique vice ordinary least squares or 
stepwise regression, and the predictands were either 
recurvature / non-recurvature or corrections made to a first 


guess represented by an analog mean position. 


Be. RIDGE REGRESSION 


Ridge regression is a type of biased estimator for data 
analysis and model building. The name "ridge" is in no way 
related to the meteorological usage of the term “ridge”. 
Ridge regression is a useful technigue for dealing with 
highly correlated (non-orthogonal) predictor variables 
because it can develop a set of stable coefficients when 


more classical methods cannot. Since the predictors used in 
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this research were highly correlated, ridge regresSion was 
used and the results tested against the classical least 
Squares method. The least squares method is inferior for 
non-orthogonal problems. The large variance inflation of the 
estimated coefficients, caused by highly correlated 
predictors, results in highly unstable coefficients. Of 
course, the presence of gross errors, missing values, and 
other problems can create nonsense results regardless of the 
regression techniques, but ridge regression handles these 
problems better since it utilizes a little bit of several 
highly correlated variables rather than using some variables 


and excluding the remaining ones. 


The "name of the game" is still coefficient mean square 
error reduction, but ridge regression does it a little 
differently than ordinary least squares. Mean square error 
(MSE) = variance + (bias)* - Two key properties of the least 
squares estimator are that it iS unbiased (bias = 0), and 
that for crthogonal problems the variance 1S a minimum. for 
non~orthogonal problems, however, the variance becomes large 
and so does the MSE. The ridge regression eStimator allows 
a little bias in exchange for a much smaller variance. 
Ridge regression then seeks an optimum bias which wili 


reduce the coefficient MSE to a minimun. 


Recall from the standard model for multiple linear 
regression (Y = XB + e) that the least squares estimator of 
(B) is 

BY = (x'X) xX'Y 
where, (Y) is the vector of observations on the dependent 
Variable, (X) is the matrix of observations on the 
independent predictor variables, X' 1s the transpose of X, 
{X'X) is the correlation matrix, (e) is the vector of 
experimental errors, and (B") is the vector of population 


values of the parameter. 
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The ridge regression estimator (B"*) , as described by 

Hoerl and Kennard (1970), is 
Bie = (X'X + KI) X'Y 

where k is a positive constant usually in the range froa 
zero to one. Note that when k=0, B" and B"* are equal. With 
respect to MSE, variance is a decreasing function of k, and 
bias is an increasing function of k. In. | practice, Ky¥o1vs 
added to the diagonal of the correlation matrix, each 
element of which is identically 1.0, and the matrix is 
restored to correlation form by dividing through by (1+tk). 
This reduces the size of all the correlation coefficients 
and thus reduces the apparent non-orthogonality which may 
improve the numerical analysis. For each value of (xk) 
assigned, a separate inversion of the matrix (X'X + kI) is 
calculated and a plot of (k) versus each resulting 
coefficient is made. The result of plotting all the 
combinations is called the "ridge trace" . (see Figure 2.) 
The ridge trace is a diagnostic tool which portrays the 
effects of the non-orthogonality on the systen of 
coefficients, and allows selecion of an optimum bias (k) 
where the system becomes stable and the MSE of the 
coefficients may be smaller than that from least squares 
regression. The ridge trace can also be used to screen 
predictors by eliminating those with the very small 
coefficients; however, new computations for another ridge 
trace must be made for the remaining predictors since the 


high correlations will have been altered. 


The length of the vector B"*, the square root of the sun 
of squares of its elements, is a maximum for k=0 (ordinary 
least squares). As (kK) increases, the length of B"* 
decreases. This is important with noisy data where there is 
sone noise associated with each predictor. Since the 
coefficients tend to be smaller, less noise is included in 
each term of the predicted value; and since the coefficients 


tend to be more uniform in magnitude, random noise in the 
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several terms tends to cancel out. 
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A. PREDICTION OF RECURVATURE 


To improve upon the analog forecasts it was necessary to 
first predict which of the two analog schemes (TYFOON 
RECURVE or fYFOON STRAIGHT) to use as a first guess 


forecast, that is to predict recurvature or non-recurvature. 


The concepts of straight and recurving tropical cyclone 
tracks are not well defined. For instance, a recurving storn 
and a straight storm may have identical tracks for several 
days when South of the subtropical ridge under the influence 
of the Easterlies. For the purpose of this thesis we 
classified a storm as recurving if its track turned out, 
after the fact, to have been better described by the 
recurving analog track forecast, otherwise it was labeled 
straight. With this definition of a straight/recurve track 
it was necessary to make a straight/recurve forecast at each 
point along the track, and it was possible for a storm to 
change back and forth between classes, at least while South 
of the subtropical ridge. Although such forecasts are 
clearly not independent of each other, they were treated as 
such. This treatment. is tantamount to a statistical 


assumption which later proved to be a source of troubie. 


Be. CORRECTICN TO ANALOG FORECASTS 


18 





The predictors available for forecasting position 
corrections were the North/South and East/West gradients at 
all of the 14 points of figure 1. What we were looking for 
were predictors that would indicate the displacement of a 
storm in time from the first guess position which 
represented a forecast by either a straight or recurving 
analog scheme. For example, 1f£ a basic recurvature path were 
forecast, we would expect abnormal North/South gradients 
along the analog track to correspond to abnormal East/West 


displacements of the cyclone from the analog track. 
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A. FORECAST SCHEMES 


Four different forecast schemes were tested and compared 
to the JTWC official forecasts for a homogenous set of 


forecast cases. 





After the recurvature forecast was made objectively, 
the straight or recurvature analog forecast position was 


used as the forecast. 


2. Ridge Reqression 


After the recurvature forecast was made objectively, 
the "best" ridge equations were used to correct the analog 


forecast position. "Best" was determined on dependent data. 


3. Least Sguares 


SSD ome =a ao 


The same as (2) except that ordinary least squares 
replaced ridge regression as the method of determining 
predictive equations. . 
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4. Ridge/First Guess Mix 


Essentially the same as (2), except that when 
straight was forecast, no correction aS applied to the 
straight analog forecast. This recognized that straight 
storms are South of the subtropical ridge near the boundary 
of the FNWC primitive equation model in an area where the 


fields are suspect. 
Be. FORECAST ERRORS 


Recall that in each of the forecast schemes above, the 
first step was a prediction of straight/recurvature. Our 
performance in this area waS so poor that our forecast 
results were largely meaningless except for some specialized 
purposes. We were in the wrong straight/recurvature 
Classification at least half the time, and were usually 
applying our corrections outside the area for which they 
were designed. Table 1. compares the relative errors of the 
Various forecast schemes. The better performance of the 
First Guess scheme over the other three schemes indicates 
that no correction is superior to a doubtful correction. The 
Ridge Regression scheme shows some slight though not 
Significant improvement over the Least Squares scheme. The 
comparison cf scheme (4) to scheme (2) should lend some 
Support to the value of the FNWC fields, since scheme (4) 
forecasts only where those fields are thought to be most 
representative at the higher latitudes of the frecurving 


storn. 
The forecast improvement (ridge over least squares) was 


Significant when the correct straight / recurvature 


classification was specified rather than forecast. (see 
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Table 2.) The relative standings of the various schemes did 
not change, but more significantly we see that the First 
Guess scheme (no correction) was still superior to the 
others. 


C. INVESTIGATION OF RESULTS 


The prediction of straight / srecurvature was very 
accurate (approximately 90 percent) for the dependent 
Sample. This dropped down to about 45 percent in the 
independent sample. This suggested any of several classical 
statistical blunders. Our procedures were investigated for 
Signs of bias or systematic selection of cases or other 


statistical nonsense. 


A comparison of correlation coefficients of dependent 
and independent data samples was considered elementary to an 
examination cf the data stratification. We wanted to 
determine whether two correlation coefficients, associated 
with the same predictor-predictand pairing in both the 
dependent and independent samples, differed at a .90 
confidence level. This was done by uSing a test statistic 
derived from Fisher's (z) ‘transformation, which is 
approximately normally distriputed. The correlation 
coefficients were plotted, dependent against independent. 
(see Figures 3, 4, and 5) The upper and lower lines (solid) 
define the area wherein the two correlation coefficients are 
not significantly different at a .90 level. Figures 3, 4, 
and 5 show that as the number of forecast cases decreased, 
the reliability of predictors common to the independent and 
dependent samples decreased. The Fisher's statistic uses a 
Variance inversely related to the number of cases. Since 
our correlations frequently differed in excess of that 


expected, one had to suspect the statistical procedures or 
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assumptions. After checking the computational procedures, 
the only assumption of any consequence was that we had "N" 


independent forecast cases. 


When you consider that the average life span of a 
tropical cyclone may be 3-5 days, then time adjacent 
measurements cf pressure gradients (predictors) at 12 hour 
intervals during this life span are obviously not 
independent. In an attempt to test what our effective "N" 
Size was, we speculated that we had one independent case for 
each tropical cyclone in the independent sample. This must 
apply to the dependent sample as well, but since the 
dependent sample was nearly four times as populous as_ the 
independent sample, we assumed that the dependent 
correlaticn coefficients were accurate. The .90 percent 
confidence intervals were again computed with the assumed 
effective "N". (see Figures 3, 4, and 5) The number of 
points within the .90 confidence interval (dashed lines) 
increased to reasonable expectations. If the assumption that 
the dependent coefficients are accurate was true, then the 
poor forecasting would be solely attributable to bad Luck in 
selection of the independent sample, and would not reflect 
expected results given a representative group of forecast 


cases. 


The physical "reasonableness" of the predictors used to 
predict straight / recurvature was examined. Roughly one 
half appeared to be reasonably related to the predictand, 
and the remaining appeared to be unrelated from a physics 
Viewpoint. This suggested that physical reasonableness 
should have been more of a criterion for selecting 
predictors during the fridge trace analysis vice simply 


choosing an arbitrary number. 
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VI. CONCLUSIONS 


The objective of determining the usefulness of the 
outlined approach £oR predicting recurvature or 
non-recurvature was inconclusive. Apparent is the 
requirement for a data set many times as large as the two 
year sample used here. This suggests a wait of several years 


Or a Simulaticn problem to "manufacture" cases. 


The objective of proving the value of ridge regression 
met with scme success. In nearly every confrontation, the 
"ridge" eguations were Superior to ordinary least squares. 
The superiority was striking in only a few instances, 
however, and even this is clouded since even the -best 
equations could not Sustain their promised variance 
reduction through the test of independent data. 


Probably the most valuable conclusion here is that the 
most fruitful area for application one model output 
statistics to the tropical cyclone problem is in the basic 
problem of recurvature / non-recurvature. The results of 
the attempt to correct a good first guess by the use of 
synoptic gradients from the FNWC model, though not 
compelling, are strongly suggestive that such improvement 


will be minor if any. 
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TABLE I 


Mean forecast errors (NM) when predicting 
recurvature/non-recurvature. 


1 2 3 ; 4 No, 
Forecast {| Official First Ridge Least Ridge/First | Forecast 


Period “JTWC. Guess Regressicr} Squares |Guess Mix} Cases 
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PABLs II 


Mean forecast errors (NM) when civen 
recurvature/non-recurvature. 


No. 
Forecast | Official Forecast 


Period | J.T.W.C. 






Cases 





24-hr Laie ee 125 


48-hr 248 182 92 
7 2-hr 401 237 61 


* Ridge/First Guess Mix not calculated. 
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Figure 2 - Example of a ridge trace, 
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Figure 3 = 24 hour straight/recurve prediction, dependent 
* ¥S. independent correlation coefficients, 
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Figure 4 - 48 hour straight/recurve prediction, dependent 
vs. independent correlation coefficients. 
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Figure 5. - 72 hour straight/recurve prediction, dependent 
vs. independent correlation coefficients. 
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